The Unreasonable Effectiveness of Deep Evidential Regression
نویسندگان
چکیده
There is a significant need for principled uncertainty reasoning in machine learning systems as they are increasingly deployed safety-critical domains. A new approach with uncertainty-aware regression-based neural networks (NNs), based on evidential distributions aleatoric and epistemic uncertainties, shows promise over traditional deterministic methods typical Bayesian NNs, notably the capabilities to disentangle uncertainties. Despite some empirical success of Deep Evidential Regression (DER), there important gaps mathematical foundation that raise question why proposed technique seemingly works. We detail theoretical shortcomings analyze performance synthetic real-world data sets, showing heuristic rather than an exact quantification. go discuss corrections redefinitions how uncertainties should be extracted from NNs.
منابع مشابه
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
While it is nearly effortless for humans to quickly assess the perceptual similarity between two images, the underlying processes are thought to be quite complex. Despite this, the most widely used perceptual metrics today, such as PSNR and SSIM, are simple, shallow functions, and fail to account for many nuances of human perception. Recently, the deep learning community has found that features...
متن کاملThe unreasonable effectiveness of martingales
Proof. Consider p-bond percolation on an an infinite dregular tree T rooted at ρ and write CT (ρ) for the component containing ρ. Write CG(v) for the component of v in Gp. It is clear that we can couple such that |CG(v)| ≤ |CT (ρ)|. Recall the exploration process on T : At time t = 0 only ρ = v1 is active, other vertices neutral. At time t ≥ 0 if the number of active vertices Mt > 0, then set t...
متن کاملThe Unreasonable Effectiveness of Mathematics
Recognizing mathematics as a human creation, Wigner (and Einstein too) wondered at our ability to build mathematical models that predict events beyond experience, and with uncanny precision! In this talk, we’ll consider a psychological approach to mathematical foundations and development–an approach that provides some reason for the effectiveness of mathematical models. In taking this approach,...
متن کاملUnreasonable Effectivness of Deep Learning
We show how well known rules of back propagation arise from a weighted combination of finite automata. By redefining a finite automata as a predictor we combine the set of all k-state finite automata using a weighted majority algorithm. This aggregated prediction algorithm can be simplified using symmetry, and we prove the equivalence of an algorithm that does this. We demonstrate that this alg...
متن کاملThe Unreasonable Effectiveness of Random Orthogonal Embeddings
We present a general class of embeddings based on structured random matrices with orthogonal rows which can be applied in many machine learning applications including dimensionality reduction, kernel approximation and locality-sensitive hashing. We show that this class yields improvements over previous stateof-the-art methods either in computational efficiency (while providing similar accuracy)...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2023
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v37i8.26096